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EXECUTIVE  SUMMARY 


The  Data  Acceptance  (DA)  and  Quality  Assurance  (QA)  of  Engineering 
Drawing  data  at  government  repositories  today  is  a  time  consuming 
process  that  requires  considerable  human  and  facility  resources. 

Currently,  all  engineering  drawings  must  be  viewed  by  an  operator  at  an 
image  workstation.  Technology  advances  in  the  analysis  of  digital  data 
offer  computer-assisted  techniques  that  can  be  applied  to  the  DA/QA  of 
engineering  drawings  and  documents.  The  application  of  this  technology 
to  DA  of  digital  data  provides  a  cost-effective  alternative  to  the 
interactive  viewing  of  data  at  an  image  workstation. 

This  report  describes  the  techniques  that  were  demonstrated  and  the 
potential  benefits  of  applying  these  computer-assisted  techniques  to  the 
DA\QA  of  engineering  drawing  data. 

The  areas  of  concentration,  for  this  demonstration,  were  Image  Quality 
and  Identification  Data.  The  techniques  were  demonstrated  by  processing 
a  suite  of  test  data  that  was  scanned  into  a  microprocessor  image-based 
system.  This  data  suite  contained  light,  dark,  noisy,  skewed  and  good 
quality  image  data.  The  Image  Quality  demonstration  showed  that  poor 
quality  images  could  be  detected  by  use  of  computer-assisted  techniques. 
The  Identification  Data  demonstration  showed  how  key  identification 
data,  such  as  drawing  number  and  size,  can  be  recognized  within  the  image 
area. 

The  demonstrated  techniques  indicate  that  the  technology  available  today 
Is  applicable  to  the  DA  of  digital  data  and  are  viable  options  for  the 
improvement  of  the  digital  data  acceptance  process. 

Additional  evaluation  and  testing  of  these  and  other  advanced  techniques 
is  recommended. 
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1. 


PURPOSE 


This  report  documents  the  techniques  that  were  demonstrated  and  describes 
other  potential  techniques  that  are  candidates  for  the  Computer-Assisted 
acceptance  of  digital  data  (DA). 


2.  SCOPE 

This  report  describes  the  background  that  points  out  the  need  for  computer- 
assisted  data  acceptance  procedures,  the  research  and  analysis  of  existing 
techniques/tools,  the  impact  these  techniques  have  on  the  acceptance  of 
digital  data,  other  advanced  techniques  under  consideration  and  the  results 
of  the  demonstration.  The  need  for  further  testing  of  the  demonstrated 
techniques  and  other  advanced  techniques  is  addressed  in  the 
recommendation  section  of  this  report. 

3.  BACKGROUND 

Analysis  of  existing  acceptance  procedures  at  government  repositories,  the 
comments  from  the  review  of  manual  data  acceptance  procedures  and  their 
field  testing  points  up  the  need  for  automating  the  acceptance  of  this  digital 
data.  The  manual  viewing  of  the  digital  data  on  image  workstations  for 
QA  and  acceptance  is  a  time  consuming  process  and  requires  considerable 
manpower,  hardware/software  and  facilities  resources.  When  the 
repository  resources  are  used  for  full  100%  DA/QA  of  the  data,  ±e  prime 
mission  of  storing,  retrieving  and  distributing  data  is  impacted. 

The  present,  manual  efforts,  required  to  develop,  store,  reproduce  and 
distribute  data  on  aperture  card  media  is  costly  and  due  to  the  handling  of 
the  data  results  in  poor  quality  data  that  is  difficult  to  reproduce.  The 
production  of  digital  data  for  new  weapon  system  procurement  will  greatly 
improve  the  quality  of  the  data  however  the  aperture  card  is  still  a  large 
source  for  conversion  to  digital  data.  How  can  the  costly,  time  consuming 
QA  and  use  of  resources  be  reduced.  One  alternative,  is  to  maximize  the 
use  of  computer-assisted  techniques  to  analyze  the  image  data  and 
identification  data  of  the  delivered  drawing  or  document. 


1 


A  number  of  the  manual  procedures  were  identified  as  candidates  for  the 
application  of  computer-assisted  techniques.  The  two  most  obvious  areas 
were  those  of  analyzing  the  image  data  content  for  quality  and  the 
verification  of  the  identification  data  that  is  presented  in  a  number  of  places 
(Contractor  furnished  Data  List,  1840A  Header  and  the  final  repository 
generated  directory/index  data  list).  Other  areas  where  computer-assisted 
techniques  could  be  applied  were  administrative  control  and  use  of  support 
data  and  the  many  techniques  for  the  retrieval  and  display  of  image  data. 

Technical  advancements  were  researched  in  the  analysis  of  digital  image 
data  and  algorthms  were  reviewed  that  would  be  applicable  to  the 
acceptance  of  digital  engineering  drawing  data.  A  selected  few  were 
analyzed  and  integrated  into  a  common  platform  for  demonstration 
purposes  only.  Other  advanced  techniques  are  available  and  the  techniques 
selected  for  demonstration  will  require  additional  testing  in  a  batch  mode 
environment  before  they  could  be  recommended  for  production 
implementation.  The  results  discussed  within  this  report  demonstrate  the 
practicality  of  using  such  techniques  to  provide  background  or  off-line 
computer-assisted  acceptance  of  digital  data. 
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4.  THE  IMPACT  OF  USING  COMPUTER-ASSISTED 

TECHNIQUES  IN  DATA  ACCEPTANCE  PROCEDURES 


The  acceptance  of  digital  data  requires  the  visual  viewing  of  the  image  and 
identification  data  on  an  image  monitor.  Computer-assisted  preparation  and 
display  of  the  key  identification  data  such  as  drawing  number,  revision,  size  and 
etc  has  improved  the  access  and  display  of  the  data  and  therefore  reduced  the  time 
to  QA  the  drawing.  Display  editing  techniques  and  the  use  of  windows  to  provide 
simultaneous  display  of  the  key  identification  data  and  image  data  can  be  used  to 
further  reduce  the  time  for  viewing  and  accepting  the  displayed  data. 

Greater  benefits  can  be  derived  in  the  overall  acceptance  of  the  data  if  the  human 
interaction  can  be  reduced  to  viewing  for  final  acceptance  on  a  sampling  basis 
only.  The  objective  then  is  to  develop  and/or  integrate  computer-assisted 
techniques  that  can  analyze  the  content  of  the  image  file  for  quality.  These 
algorithms  must  address  noise  content,  contrast,  lighmess  and  darlmess  features 
based  on  the  size  of  the  image.  Statistical  analysis  algorithms  can  compare  the 
black  pixel/compressed  pixels  by  image  size  to  determine  lighmess  and  darkness. 
If  these  algorithms  can  detect  poor  quality  images  consistently  then  this  will  have 
a  big  impact  on  the  time  it  takes  to  QA  and  accept  the  data.  Also  if  the  computer- 
assisted  technique  can  be  implemented  to  operate  in  a  batch  mode  and  in  an 
unattended  marmer  then  this  can  occur  during  off  peak  production  hours  which 
wiU  be  an  additional  benefit.  A  summary  of  the  impact  areas  are: 


1.  Manual  comparison  of  Image  ID  information  with  the  hard  copy 
print  out  of  the  key  ID  data  from  the  computer. 

2.  Final  Acceptance  Visual  QA  (Reduced  to  sampling  only) 

3.  Data  Acceptance/Rejection  Letter  Preparation 

4.  Improved  productivity  on  ±e  Repository  System 

(  Greatly  increased  depending  on  where  the  techniques  are 
implemented,  i.e.,  contractors  site,  stand-alone  system  or  both.) 

5.  Administrative  Report  Areas: 

-  Data  List  (Electronic  on  magnetic  tape) 

-  Document  Identifier  Report 


3 


-  Acceptance/Rejection  Reports 

-  Elimination  of  other  manual  reports/acceptance  sheets 

6.  Contractor  performance  will  be  more  closely  monitored  with  on-site 
implementation  of  these  computer-assisted  procedures  and  result  in 
improved  quality  data. 

7.  Ih-process  technical  reviews  can  utilize  the  computer-assisted  DA 
procedures  by  performing  in-line  data  verification  when  remotely 
accessing  image  drawing  data  from  a  contractors  site  or  on  GFE  at 
the  contractors  site  that  have  the  DA  procedures  operating. 

8.  Commonality  of  DA  procedures  for  CALS  data  allows 
implementation  of  the  procedures  at  various  locations  depending  on 
the  volume  of  data  ordered.  This  could  be  a  significant  cost  savings 
in  both  labor,  training  and  hardwareNsoftware  resources. 

Figure  1  shows  the  flow  of  data.  Three  areas  are  highlighted  where 
Computer-Assisted  DA  could  be  applied  depending  on  the  specific 
contract  requirements. 
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CONTRACTOR  SITES 


GOVERNMENT  SITES 


Figure  1  -  Data  Acceptance/Quality  Assurance  Process  Flow 


5 


5.  TECHNIQUES  DEMONSTRATED 


The  Demonstration  was  designed  to  show  how  the  selected  techniques 
perform  and  how  they  may  be  incorporated  in  the  Data  Acceptance/Quality 
Assurance  Procedures.  The  two  major  areas  addressed  were  IMAGE 
QUALITY  and  IDENTmCATlON  DATA  MATCHING.  Each  area  will 
be  discussed  in  the  following  paragraphs  as  a  background  to  the  detail 
discussion  of  the  techniques  and  demonstration  enviromnent. 

Image  Quality  inspection  involves  many  different  interactions  between  the 
person  performing  the  inspection  and  the  image  being  inspected.  The 
specific  approach  varies  from  person-to-person,  however  the  normal 
process  involves  the  following  steps: 


STEP  1  is  to  enter  a  drawing  number  as  an  index  or  select  from  an 
index  directory  screen  to  access  the  image  to  be  inspected.  This 
usually  results  in  a  display  of  the  lower  right-hand  portion  of  the 
drawing  on  the  screen. 

STEP  2  will  pan  the  screen  "window”  around  the  drawing  so  that 
the  operator  can  check  the  overall  legibility  of  the  image  area  and  if 
satisfactory  will  then  check  the  border  areas,  revision  block,  if 
present,  and  start  to  observe  the  "legibility"  of  the  text  and  geometry 
within  the  borders. 


STEP  3  will  investigate  any  suspected  problems  by  "zooming-in"  to 
magnify  the  area  in  question.  Reject  conditions  will  be  collected  for 
a  form^  rejection  notice. 

STEP  4  will  visually  locate  each  of  the  key  identification  fields 
within  the  image  area  and  visually  compare  each  with  a  machine 
representation  of  the  field  as  taken  from  the  aperture  card  punch 
fields  or  by  key  entry.  For  CALS  data,  the  identification  data  is 
located  in  the  header  of  the  magnetic  tape  format.  The  identification 
fields  compared  in  this  manner  are,  at  a  minimum: 

-  Engineering  Drawing  Size  (A,B,C,,  etc.) 

-  Engineering  Drawing  Number 

-  Revision  Number 
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-  FSCM  Number  (Contractors’  group  code) 

-  Sheet  Number 

Other  fields  may  be  checked  depending  on  the  specific  contract 
requirements  and  site  policies. 

STEP  5  completes  the  inspection  with  release  of  the  image,  as 
acceptable  or  unacceptable,  from  the  screen  to  prepare  for  the  next. 
The  operator  maiks-up  the  data  list  for  the  current  batch  to  reflect 
the  inspection  of  the  image. 

The  major  areas  were  studied  separately  and  the  essential  process  in  each 
was  defined.  In  the  case  of  Image  Quality  the  essential  process  is  the  overall 
assessment  of  contrast  and  sharpness.  The  image  is  considered  to  be  the 
foreground  and  the  other  "color”  (black  or  white)  the  background.  Thus,  with  a 
white  or  clear  background  each  picmre  element  consists  of  a  black  or  opaque 
area.  The  size  of  this  "pixel"  depends  on  the  resolution  used  when  the  original 
image  was  digitized.  TTie  standard  resolution  for  engineering  drawings  is  200 
dots  per  inch. 

A  line  drawn  one  pixel  wide  would  be  .005  inches  or  about  like  a  sharp  pencil 
line.  The  minimum  engineering  drawing  line  width  is  .010  to  .012  inches  and 
therefore  should  be  "seen"  by  the  scanner  under  normal  conditions.  From  the 
point  of  initial  capmre,  through  reproduction,  and  digitization  and  storage  there 
is  the  opportunity  for  image  degradation. 

The  types  of  degradation  that  could  be  detected  by  computer-assisted  techniques 
were  identified  as  Light,  Dark,  Noisy,  and  Skewed.  These  interact  with  all  areas 
and  feamres  of  the  image  and  represent  a  first  approach  to  Computer-Assisted 
Inspection  of  Engineering  Drawings.  It  should  be  noted  here  that  localized  areas 
and  features  that  become  impaired,  depending  on  size  and  degree  of  impairment 
will  not  be  detected  by  large  area  and  statistical  methods.  It  is  possible  to 
subdivide  the  image  in  order  to  concentrate  the  inspection  and  be  more  precise 
(See  Section  6  -  Advanced  Techniques  Under  Consideration). 

The  demonstration  shows  how  the  image  quality  and  identification  data  can  be 
verified  by  use  of  Computer- Assisted  techniques  and  thereby  reduce  the 
requirement  for  operator  QA  of  all  images.  Final  DA  wiU  still  be  performed  by 
an  operator  but  can  be  reduced  to  inspection  of  questionable  data  and  sampling  of 
acceptable  data.  A  description  of  the  demonstrated  Image  Quality  algorithms 
follows. 
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To  address  the  light  and  daiic  analysis,  an  algorithm  (patent  pending)  was 
investigated  that  had  been  originally  developed  for  QA  processing  during  the 
digitization  of  drawings.  This  algorithm  has  been  re-hosted  to  an  Apple  n 
platform  and  merged  with  the  Blueridge  Technologies  OPTIX  system  for  Phase 
H  Data  Acceptance.  (See  Figure  2  -  Statistical  Analysis  (B/C),  Courtesy  of 
Staple  Vision  Inc.) 

Enhancements  to  this  algorithm  include  a  ranking  reject  mechanism,  a  forward 
and  reverse  averaging  mechanism  and  the  ability  to  apply  a  batch  control  process 
to  the  image  stream.  Based  on  site  policy  or  contract  guidance  an  arbitrary 
percentage  of  the  batch  may  be  marked  for  manual  inspection,  starting  with  the 
highest  and  lowest  extremes  and  working  toward  the  center.  This  says  that 
regardless  of  the  evaluation  or  re-evaluation  decisions,  the  image  may  be  rejected 
due  to  the  ranking  reject  parameter.  As  an  example,  if  ranking  reject  was  set  to 
5%  for  a  200  image  batch  then  the  10  "worst”  images  will  be  rejected  (See 
Appendix  D  -  Ranking  Reject  Sample). 

The  evaluation  of  an  image  is  performed  by  determining  the  ratio  of  total  black 
pixels  in  the  image  (B)  and  the  Group  IV  compression  factor(C).  This  B/C 
statistic  is  compared  with  an  expected  value  and  a  good/bad  decision  is  made. 
Based  on  the  forward  average  number  n,  this  image  will  be  re-evaluated  n  images 
later.  This  provides  a  smoothing  effect  for  a  sudden  shift  in  image  values  within 
a  batch.  The  same  type  of  operation  is  applied  with  the  reverse  average  number. 
After  each  batch  is  processed  the  running  averages  are  reset  Multiple  batches 
may  be  processed  in  one  session  (background).  Each  decision  is  output  to  a  batch 
log  file  for  subsequent  reduction  and  presentation. 

The  following  chart  shows  the  results  of  processing  a  set  of  aperture  card  images 
using  the  statistical  algorithm  (B/C).  The  X  axis  is  the  Log  of  the  compression 
ratio.  The  range  of  compression  ratios  for  Engineering  Drawings  is  normally 
firom  2  to  50  with  most  images  falling  in  ±e  8  to  20  area.  The  Y  axis  plots  the 
log  of  the  Fill-Factor  or,  in  other  words,  the  number  of  black  pixels  in  the  image 
area. 

Drawings  that  are  very  light  will  produce  both  a  low  compression  ratio  and  a  low 
black  count.  Drawings  that  contain  a  lot  of  geometry  and/or  text  will  have  a 
higher  black  count  and  usually  a  low  compression  ratio  due  to  the  large  number 
of  transitions.  The  other  extremes  are  "Sparse”  and  "Dark"  images. 
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It  should  be  noted  that  the  scatter  of  data  shows  a  pronounced  orthogonal  aspect 
to  the  "Light  -  Dark"  axis  and  is  grouped  along  the  "Sparse  -  Busy"  axis.  The 
testing  verified  that  images  falling  out  of  the  "band"  were  of  lower  quality. 


Log(FF) 


Figure  2  -  Statistical  Analysis  (B/C) 


The  preceding  statistical  analysis  algorithm  requires  a  total  black  count  for  each 
image.  These  values  are  generated  and  passed  by  the  Noise  Analysis  and 
Verticality  Analysis  package  which  will  now  be  discussed. 

The  Noise  Analysis  algorithms  as  implemented  in  ±e  Image  Management 
platform  predicts  the  acceptability  of  an  image  by  looking  for  black  and  white 
"orphans".  An  orphan  is  defined,  currently,  as  a  single  pixel  surrounded  by 
pixels  of  the  other  color.  The  algorithm  treats  white  orphans  as  much  more 
indicative  of  an  impaired  image  than  black  orphans.  This  would  be  reversed  with 
a  negative  image  and  says  that  the  foreground  contains  the  intelligence  and  that 
"drop-outs"  may  indicate  an  out-of-focus  or  scanner  problem.  This  process  also 
generates  the  total  black  count  needed  by  the  Statistical  Analysis  (B/C)  algorithm. 
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Enhancements  considered  for  this  algorithm  would  support  batch  mode  operation 
along  with  a  parameter  to  adjust  decision  threshold.  Multiple  pixel  orphan 
detection  should  be  considered  after  additional  testing. 

A  skew  analysis  algorithm  was  embedded  in  the  Noise  Analysis  package  to 
process  the  Group  IV  compression  codes.  By  grouping  and  determining  run 
length  patterns  the  algorithm  is  able  to  detect  both  direction  and  intensity  of  the 
skew  condition.  This  information  and  noise  analysis  detail  are  recorded  in  a  QC 
log  for  later  reduction  and  presentation. 

The  next  major  area  addressed  is  the  Computer-Assisted  processing  of  Key 
Identification  Data.  As  was  mentioned  in  the  description  of  manual  data 
inspection  Step  4,  the  key  identification  fields  must  be  compared  visually  between 
the  image  and  the  character  data  to  be  sure  that  ±e  data  is  accurate. 

A  survey  was  conducted  of  commercially  available  Intelligent  Character 
Recognition  systems  and  any  use  of  character  recognition  and  pattern  recognition 
with  engineering  drawings.  It  was  found  that  some  very  capable  commercial 
systems  exist  that  could  do  some  of  the  work  needed  (See  Appendic  C  for 
samples).  New  technology  (e.g.,  neural  networics)  is  reaching  the  point  of 
effective  incorporation  in  the  next  several  years. 

A  number  of  companies  working  in  the  field  of  engineering  drawing  conversion 
have  addressed  recognition  and  conversion  of  engineering  drawing  text  and 
related  symbols.  AUDRJE  Inc.  of  San  Diego  CA  has  provided  evaluation 
hardware  and  software  for  symbol  and  character  recognition  at  the  Army  CALS 
Test  Bed,  Fort  Monmouth  NJ.  The  HP/Apollo  system  is  used  to  demonstrate  the 
techniques  of  symbol  recognition  and  character  recognition  that,  with  support 
modules,  can  assist  in  the  matching  of  Key  Identification  fields  within  the  image 
of  an  engineering  drawing. 

It  may  help  to  look  at  the  problems  of  recognition  of  engineering  drawing  text. 
First,  the  problem  is  complicated  by  the  need  to  search  an  area  that  is  not  always 
the  same  location.  A  production  system  would  need  an  "expert”  capability  to 
handle  the  many  variables  associated  with  finding  the  Tide  Block  area  and 
navigating  around  the  image  to  isolate  and  segment  the  fields  to  be  recognized. 

One  of  the  more  serious  obstacles  to  recognition  is  handprinted  characters.  The 
technology  is  available  today  to  do  a  limited  level  of  handprint  recognition. 
Research  has  been  specialized  and  proprietary,  addressing  check  readers  and 
forms  readers.  It  appears,  from  the  current  level  of  activity,  that  within  the  next 
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two  years,  handprint  recognition  suitable  for  DA/QA  applications  will  be 
available.  The  demonstration  establishes  the  basic  techniques  and  initial 
procedures  for  Computer-Assisted  identification  data  matching. 

The  first  section  of  the  demonstration  made  use  of  the  Mac  Ilex,  scanner  and 
Image  Management  System,  containing  the  Noise,  Skew,  and  Statistical  algorithms 
to  show  the  effect  of  scanning  a  ’’light”,  "Daric",  "Skewed",  and  "normal" 
hardcopy  drawing. 

The  system  was  able  to  discriminate  and  report  the  abnormal  and  normal 
drawings.  Next,  a  batch  of  about  forty  images  were  processed  to  show  ±e 
operation  of  accepting  and  rejecting  images  wi±in  the  confines  of  a  batch.  The 
report  generated  by  the  B/C  algorithm  was  viewed  and  discussed.  The  effect  of 
the  various  parameter  settings  was  shown  and  questions  answered  about  the 
overall  integration  plans  for  ±e  set  of  algorithms. 

The  demonstration  of  Identification  Field  recognition  was  performed  on  the 
HP/Apollo  platform.  In  this  portion  of  the  demonstration,  patterns  were  selected 
for  recognition  in  three  drawings.  The  patterns  were  the  size  field  characters 
"A"  and  "B",  the  code  identification  number  "80063"  and  the  label  "code  ident 
no."  The  drawings  consisted  of  an  A-size  drawing  scanned  in  the  portrait 
orientation,  an  A-size  drawing  scanned  in  the  landscape  orientation  and  a  B-size 
drawing  scanned  in  the  landscape  orientation.  By  using  the  interactive 
recognition  processor  routine  of  the  AUDRE  system,  the  patterns  were 
recognized  and  the  patterns’  coordinates  were  written  to  a  file.  This  is  the  initial 
step  in  locating  and  isolating  the  Title  Block  area.  The  interactive  process  can  be 
duplicated  using  a  batch  process  so  that  pattern  recognition  can  be  executed  in  the 
background  or  during  off-peak  hours. 

The  next  section  will  describe  Advanced  Techniques,  consisting  of  extensions  and 
expansions  of  the  demonstration  techniques  as  well  as  new  techniques  that  may  be 
investigated  and  proposed  for  integration  in  the  fumre. 
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6.  ADVANCED  TECHNIQUES  UNDER  CONSIDERATION 


The  term.  Advanced  Techniques  is  used  to  describe  both  extensions  to 
previously  defined  Techniques  (Identification  Field  recognition.  Image 
Quality  and  Data  List  Automation)  and  new  techniques  not  addressed  to 
date.  Candidates  for  consideration  are: 

-  Improved  Operator  Display  Techniques  for  QA 

-  DA/QA  Report  Generation  Requirements 

-  Tiled  Raster  QA  Techniques  (28002,  Type  II  and  EDMICS) 

-  IGES  QA  Techniques  (28000) 

-  CGM  QA  Techniques  (28003) 

-  SGML  QA  Techniques  (28001) 

-  Image  Restoration  Techniques  and  Issues 

-  Digital  Signatures  for  Data  Acceptance 

The  requirements  for  extension  and  testing  of  current  techniques  are 
discussed  next,  followed  by  a  description  of  how  new  candidates  will  be 
handled. 

Image  Quality  extensions  proposed  for  the  areas  of  Noise  Analysis, 
Statistical  Analysis,  and  Skew  Analysis  concentrate  on  providing  a  shell 
under  which  aU  of  the  techniques  can  be  exercised  and  produce  a 
consolidated  report.  The  report  would  summarize  and,  where  possible, 
graphically  display  the  results.  To  explain  further,  given  a  batch  of  images 
and  related  header  information  as  input,  (e.g.,  1840A)  each  technique 
would  be  applied  serially  with  a  resultant  consolidated  report  record  output 
for  each  image.  The  report  records  would  then  be  processed  to  produce  a 
batch  or  multi-batch  report. 

The  package,  including  the  shell,  would  be  modular  such  that  additional 
quality  techniques  could  be  easily  added  and  the  report  module  could  be 
tailored  by  site  policy  and/or  contract  requirements. 

Extensions  to  the  individual  techniques  include  consideration  of  multiple 
pixel  noise  analysis;  measurement  of  the  degree  of  skew;  and  ability  to 
sample  selective  areas  within  an  image  for  B/C  calculation.  Data  List 
automation  wiU  be  extended  as  necessary.  Testing  and  documentation  of 
the  techniques  and  extensions  is  planned  for  FY91. 
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7.  CONCLUSION 


The  techniques  demonstrated  show  how  the  image  quality  and  the  key 
identification  data  can  be  analyzed  to  provide  data  acceptance  by  use  of 
computer-assisted  means  and  thereby  reduce  the  requirement  to  visually 
QA  each  image  for  acceptance. 

The  techniques  demonstrated  have  not  been  fully  tested  and  other 
techniques  are  available  that  require  evaluation.  The  demonstration  does 
show  that  the  techniques  are  valid  and  deserving  of  further  evaluation. 
Further  testing  using  a  suite  of  test  data  that  ranges  from  very  light  images 
to  very  dark  images  is  required.  Integration  of  the  tested  techniques  will 
required  testing  at  a  higher  level  before  the  techniques  are  implemented  in 
a  real-time  data  acceptance  production  environment. 

The  demonstration  is  the  first  phase  in  the  evaluation  of  computer-assisted 
techniques  that  can  be  applied  to  pre-acceptance  of  digital  engineering 
drawing  data  either  at  the  contractor  site  or  at  the  user  site.  The 
recognition  of  the  key-ID  data  within  the  image  area  is  a  valid  step  to  take 
now  as  the  technology  is  improving.  As  more  and  more  of  the  engineering 
drawing  data  are  developed  from  CAD  or  CAE  workstations,  the  character 
data  will  be  less  difficult  to  detect  when  compared  with  some  of  the  hand 
written  data  originating  from  3rd  or  4ih  generation  apermre  cards. 

The  demonstration  supports  the  belief  that  technology  is  available  that  can 
be  cost-effectively  applied  to  the  acceptance  of  digital  engineering  drawing 
data. 
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8 .  RECOMMENDATIONS 


The  techniques  demonstrated  prove  that  the  technology  can  be  applied  to 
the  acceptance  of  digital  data  however  these  techniques  and  others  must  be 
tested  individually  and  in  an  integrated  mode.  This  requires  that  a  wide 
range  of  data  be  used  and  extensive  analysis  of  the  results  be  made  before 
specific  techniques  can  be  recommended  for  implementation. 

A  great  deal  of  work  is  being  done  within  industry  and  at  the  University 
level  in  the  digital  imaging  area.  These  advanced  techniques  should  be 
reviewed  for  direct  application  to  the  acceptance  of  digital  data.  Further 
analysis  of  a  selected  few  may  be  required  and  if  warranted,  testing 
conducted. 

It  is  important  that  the  CALS  test  beds  and  the  tri-services  repositories  be 
involved  in  the  application  of  the  computer-assisted  techniques  to  the 
acceptance  of  digital  data  and  therefore  further  demonstrations  should  be 
scheduled  and  the  results  of  the  testing  be  documented  and  distributed  for 
their  inputs. 

It  is  therefore  recommended  that: 


1.  More  extensive  testing  of  the  demonstrated  techniques  be 
accomplished. 

2.  Review  and  Analysis  of  Advanced  Techniques  for  computer- 
assisted  data  acceptance  be  made. 

3.  Further  Demonstrations  be  conducted  with  more  involvement 
of  the  CALS  community  and  the  CTN  participants  in 
particular. 
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APPENDIX  A 


Appendix  A  contains  the  set  of  overheads  used  in  the  demonstration. 
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Introduction  To  Computer-Assisted 
Techniques  For  Digital  Data  Acceptance 


•  Background:  Data  Acceptance/Quality  Assurance  -  Engineering 

Drawing  Data 

—  Original  Drawings  (  Hardcopy ) 

—  Microform  ( Microfiche,  Roil  Film,  Aperture  Cards  ) 

—  Quality  and  Conversion  (  Hardcopy  to  Microform  ) 

~  Quality  and  Conversion  (  Microform  to  Digital  Data ) 

—  Micrographics  Standards  for  Production  and  Inspection 


Army  CALS  Test  Bed  DEMONSTRATION  26  October,  1990 
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Introduction  To  Computer-Assisted 
Techniques  For  Digital  Data  Acceptance 


Current  Data  Acceptance/Quality  Assurance  Practices 
(  DSREDS,  EDGARS  and  EDMICS ) 

—  Inspecting  and  Accepting  Engineering  Drawing  Data 
Hardcopy/Microform/Digital 

—  Conversion:  Aperture  Card  Data  to  Digital  Data 


Army  CALS  Test  Bed 


DEMONSTRATION 


26  October,  1990 
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Introduction  To  Computer-Assisted 
Techniques  For  Digital  Data  Acceptance 


0  Digital  Data  Acceptance/Quality  Assurance  - 
Manual  Vs  Computer  -  Assisted 

—  Contractor  to  User:  Manual  Digital  DA/QA  Procedures 
—  Contractor  to  User:  Computer-Assisted  DA/QA  Procedures 
—  Benefits  of  Computer-Assisted  DA  Procedures 


Army  CALS  Test  Bed  DEMONSTRATION  26  October,  1990 
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Introduction  To  Computer-Assisted 
Techniques  For  Digital  Data  Acceptance 


•  Areas  Selected  for  Presentation/Demonstration  of 
Computer-Assisted  Techniques 

—  Media  Format  Verification 

—  Identification  Data  Verification 

—  Image  Quality  Verification 

—  Administrative  Data  Control 

—  Display  Presentation 


Amy  CALS  Test  Bed  DEMONSTRATION  26  October,  1990 
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Computer-Assisted  Data  Acceptance 


Army  CALS  Test  Bed 


VERIFICATION  TESTS 
—  Media  Format  — 


VERIFICATION  TESTS 
—  Identification  Data  — 


VERIFICATION  TESTS 
—  Image  Quality  — 


ADMINISTRATIVE  TESTS 
—  Data  Control  — 


WORKSTATION  DISPLAYS 


Presentation  Techniques 


DEMONSTRATION 


26  October,  1990 
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Demonstration  Techniques  Overview 


•  Noise  Analysis  (Black  and  White  Orphans) 

•  Verticaiity  Analysis  (Skew) 

•  Statistical  Analysis  (B/C) 

•  Pattern  Recognition  (Key  ID  Fields) 

•  Character  Recognition  (Machine  and  Handprint) 

•  Benefits  of  Image  Quality  and  Recognition  Techniques 

•  Demonstration  Configuration  and  Phase  III  Issues 

•  Open  Discussion  of  Computer-Assisted  Techniques 

Army  CALS  Test  Bed  DEMONSTHATION  26  October,  1990 

V _ _ _  J 


21 


Demonstration  Techniques  Overview 


#  Noise  Analysis  (Black  and  White  Orphans) 

—  Noise  sources 

—  Single  and  multiple  pixel  algorithms 

—  Demonstration  implementation 

—  Extension  possibilities 

#  Verticality  Analysis  (Skew) 

—  Source  of  skewed  images 
—  Compressed  image  algorithm 
—  Demonstration  implementation 
—  Extension  possibilities 


Army  CALS  Test  Bed  DEMONSTRATION 


26  October,  1990 


Demonstration  Techniques  Overview 


#  Statistical  Analysis  (B/C) 

—  Source  of  image  impairment 

—  B/C  statistic  development 
—  Demonstration  implementation 
—  Extension  possibilities 


Army  CALS  Test  Bed  DEMONSTRATION 


26  October,  1990 
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Demonstration  Techniques  Overview 


#  Pattern  Recognition  (Key  ID  Reids) 

—  Open  field  recognition  vs  constrained  fields 

—  Machine  vision  analogy 
—  Demonstration  implementation 

—  Extension  possibilities 

•  Character  Recognition  (Machine  and  Handprint) 

Commercial  OCR  progress 

—  New  Technologies 
—  Demonstration  implementation 
—  Extension  possibilities 


Anny  CALS  Test  Bed 


DEMONSTRATION 


26  October,  1990 


Demonstration  Techniques  Overview 


•  Benefits  of  image  Quality  and  Recognition  Techniques 
—  Pre-screening  (batch)  processing 
—  Reduction  of  key  ID  and  quality  inspection  time 
—  Early  detection  of  major  delivery  problems  and  trends 
—  Extensible  and  expandable  techniques 
—  interface  to  other  logistics  support  systems 


Army  CALS  Test  Bed  DEMONSTRATION 


26  October,  1990 
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Demonstration  Techniques  Overview 


#  Demonstration  Configuration 

—  Mac  Ilex  -  scanner  -  laser  printer 

—  HP/Apollo  with  recognition  logic 

—  Blueridge  image-processing  software  with  quality  algorithms 
—  Staplevision  software  algorithms 
—  AUDRE  Inc.  (Recognition  Hardware  and  Software) 

•  Phase  III  Computer-  Assisted  Techniques  -  Issues 

—  Extension  and  expansion  of  Phase  II  techniques 
—  Incorporation  of  new  techniques 
—  Joint  service  evaluation  of  techniques 

—  Verification  of  selected  techniques 
—  Amendments  to  CALS  specifications 
—  Application  of  techniques  to  other  data  formats 

Army  CALS  Test  Bed  DEMONSTRATION  26  October,  1990 
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Demonstration  Techniques  Overview 


•  Open  Discussion  of  Computer-Assisted  Techniques 
^  Additional  candidates  for  consideration 
—  Similar  or  related  efforts 
—  Recommendations  for  extension 


Army  CALS  Test  Bed 


DEMONSTRATION 


26  October,  1990 


APPENDIX  B 


Appendix  B  contains  sample  drawings  showing  normal,  light,  dark  and  skewed 
conditions. 
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4. 1.7.1  Sampuins  por  Group  C  inspection  op  EfluiPfiEirr; 
One  unit  op  each  40  units  or  fraction  thereof  shall  be  RANOOHLr  seucted 
FOR  Group  C  inspection. 


4. 1,7.2  floNcoMPLiANcs:  The  contractor  shall  imhebiatbly 

REPORT  IN  WRITINO  EACH  GrOUP  C  FAILURE  OCCURRENCSj  INCLUOINO  DETAILS  OP 
THE  failure  and  CHARACTERISTICS  AFFECTED.  ThE  CONTRACTOR  SHALL  IMIEDIATELT 
INVESTISATE  the  cause  of  FAILURE  AND  REPORT  THE  RESULTS  OF  IHVESTISATION 
AND  DETAILS  OF  THE  PROPOSED  CORRECTIVE  ACTION  ON  (iJ  THE  PROCESS  AND  MA¬ 
TERIALS,  AS  APPLICABLE,  AND  (ll)  ALL  UNITS  OF  PRODUCT  WNfCH  HERE  NAHUFAC- 
TUREO  UNDER  THE  SAME  CONDITIONS  AND  WHICH  THE  GOVERNMENT  CONSIDERS  SUBJECT 
TO  THE  SAME  FAILURE.  REPORTS  SHALL  BE  FORWARDED  TO  THE„ RESPONSIBLE  TECH¬ 
NICAL  ACTIVITY  OESISHATED  IN  THE  CONTRACT,  THR0U6H  THE  HUALITY  ASSURANCE 

Representative.  After  corrective  action  has  been  taicen,  additional 
SAMPLE  units  SHALL  BE  SUBJECTED  TO  SrOUF  C  INSPECTION,  AND^UROUPS  A  AND  3 
MSPECTION  may  be  REINSTOTUTEO  as  DEEMED  NECESSARY  BY  THE  GOVERNMENT. 

Final  acceptance  aho  shipment  will  be  withheld  until  reinspection  results 

have  SHOWN  THAT  THE  CORRECTIVE  ACTION  HAS  EFFECTIVE. 


4. 1.7.5  Disposition  of  units  subject  to  Group  C  Tests: 
Units  that  have  been  subjected  to  Group  C  tests  shall  be. reconditioned 
as  necessary  and  will  be  tested  for  compliance  to  Group  A  tests  and  sub¬ 
mitted  FOR  acceptance  FOR  DELIVERY. 


4.2  Inspection  and  Test  Equipment  Required 

ilRECTlOHAL  Cg 
OISE  F I  SURE 

OISE  SduRcs  hP-349A 
0  Ohm  Termination  -  Bicrc_ 

REQUENCY  COUNTER HP524Sl  WIH  5254B  CPHYERTER 
owER  Supply:  5.3  VAC,  150  vuC  and  2 
C  mill I ammeter:  0-3Q  maI  Weston  3i 
econd^IF  Simulator  s"gR  Fig.  4) 

OWER  Heter  HP-4i2A  W/noi 
Attenuator  20  oB  GR-874- 
Iuning^Orive  Assembly  - 
Tuned  Cavity  Assembly  - 
Hixer-Assembly  -  Sn-0r4. 

1st  if  Assembly  -  SM-0-42248g 
Temperature  Chamber  capable  of  -  SQOF  to  +168®F  (Stability  or  better) 

5f-yii  CT  ‘-If  PsI 

ILTER,  Low  Pass  -  Sn-fl-42 


^|ECTORS  AS  REQUIRED 
3o2-1 


Jumidity^Chamber  „ 
jPEciAL  Cable  per  Figu  5 
Shock  isst  Mount  per  Fig.  S 

^C  current  meter  capable  of  reading  0.1  TO  0.2  Amps  with  52  accuracy 

OR  better 


SIZ£ 

A 

csec  lOCNT.na 

80062L 

SI1-A-498335 

1  ti/A  1  1  -wT  8  1 

VVtMC  TO  n94W1MA  fW4INI»iFS  MTI  4««*  f  •  P"F  mm  i« 


4. 1.7.1  SAMPuiNfi  C  iMSPEcrioM  OP  gayiPMPHT: 

jHE  UMtT  OF  S-AOI  4'!  UP  ITS  OR  sR.ACTtCW  THEREOF  SHAU.  3E  RAMOOHUY  SEUSCTED 
FOR  l^ftOUP  C  INSPECTION. 

4.1. 7.1  'lOflCWPt.IAMCS:  The  contractor  SHAU.  tHMEOIATSUY 
»E.'’ORT  IN  WRITinS  EACH  jRPUP  C  FAILURE  OCCURPENCC.,  INCLWIMfi  DETAILS  OP 
THE  failure  AMR  CH  AR  ACTS.R  I  ST  I CS  AFFECTED.  IHE  CONTRACTOR  SHALL  IMMEDIATELY 
INVEST  I GATE  THE  CAUSE  OF  FAILURE  AND  REPORT  THE  RESULTS  OP  INVESTIGATION 
AND  DETAILS  OP  rtlE  PROPOSED  CORRECTIVE  ACTION  ON  ll)  THE  PROCESS  ANO  MA¬ 
TERIALS.  AS  APPLICABLE.  AND  Ul)  ALL  UNITS  OF  PRPIWICT  WHICH  HERE  MANUFAC" 
TtlREO  'JNOER  THE  SA/IS  CONOITIOHS  ANO  WHICH  THE  GOVERNMENT  CONSIDEHS  SIfl.J6rr 
TO  THE  SAME  FAILURE.  REPORTS  SHALL  3E  FORWARDED  TO  THE^RSSPONS IBLE  TECI- 
.:jlG*.L  ACTIVITY  DESIGNATED  IN  THE  CONTRACT.  THROtKJH  T^E  ''UALITw  /ISSU.RAHCE 
ilEPRESENTATtVE.  AfTSR  CORRECTIVE  ACTION  HAS  BEEN  TAXEN,  ADDITIONAL 
SAilPLC  irilTS  SHALL  BE  SUBJECTED  TO  -iROUP  C  INSPECTION,  ANO^SROUPS  ^  ANO  3 
IHSPECTIOfl  MAY  BE  REINSTITUTED  AS  DEEMED  NECESSARY  BY  THE  viOVERHMENT. 

.  I'lAL  acceptance  AHO  SHIPMENT  WILL  BE  WITHHELD  UNTIL  REIHSPSCTION  RESULTS 
HAVE  SMOHM  THAT  THE  CORRECTIVE  ACTION  WAS  EFFECTIVE. 

4. 1.7. 3  Disposition  of  units  subject  to  Group  C  Tests: 

Units  nwr  have  been  subjected  to  .iRoup  C  tests  shall  be  reconoitioneo 

AS  NECESSAfl''  AflO  will  3E  TESTED  FAR  COMPLIANCE  TO  GrchP  n  TESTS  AND  SUB- 
HITTCD  for  ACCEPTANCE  FOR  OELIVE.RY. 

4.2  Inspection  and  Test  .‘•ouiPMEfiT  "EotiiRED 


ilqisE  Tqurcs  HP-34aA 

50  Ohm  Termination  -..^crolab  T^-5?1i1  „  ^ 
rREOi/ENCY  Counter,- !!PS245l  with  52540  Converter 
Power  Supply:  5.3  MC.  IdS  VDi  .and  250  VDC 
OC  Oilliammfter:  0-3u  m«:  Heston  311 

SECOND,  IF  .'^IM'ILATOR  (PgR  FlG.  4) 

PwsR  Meter  HP-4^A  b/Toknt 
Attenuator  20  d2  r,?.-R74-023 
Iu.N INS  Drive  .Assembly  -  5*1-0-433232 
luNED  Cavity  Assembl:?  ~S;-i-C~'i22JS5 

llX£R„.^SEM8LY  - 

IST  1?  AS-SSIBLY  -  Sil-0-4224«0 

Tbiperaturc  Chamber  capable  of  -  to  +ifi8®F  CStability  tS^^F  or  better) 
U‘3C.  Cable:  and  .‘oapter  Connectors  as  reouired 
Cable  S-713  3/!;  -  lC-D-3?i35 
Filter.  Lew  Pass  -  5m-3-4225o2-1 

3UMtDtrY-,C;i.AMBF,T  , 

special  Cable  per  i  is.  d  , 

Shock  Test  ’ount  per  .^ig.  C 

.“iC  CIIR.RE.Ur  .W«-TR3  CASADLE  of  REAOftC  0.1  TO  0.2  .A.MFS  WITH  5Z  ACCURACY 
OR  3ETTE.R 


Size 

A 

eoet  iocnt.  Na 

80063. 

Sri-,A-4'ia336 

SCALZ- 

’i/A  1  i-TP 

1  »«T  S 

30 


4.L7.I  pvm  SmMP  C  inirecridN  or  cwitmENTT 

(kn  UNIT  Of  D  UN  ITS  OH  FHACTIM  THSHEOr 'SHAU.  BE  RANO(»Lr  SELZCTEO 

FOR  Group  t  inspection. 

4. 1.7.2  .WaHcaqPviAacxt  The  cohtmctm  hull  imouitely 

REPOHr  IN  MiTTNE  UCM  SnqNP  C  FEIUM  OCSI^— BE.  taoj^IHE  KTUU  OH 
THE  FAILURE  /WD  CMHACTEatfTlCS  AmcTB*.  I«  eHMMCTOR  SMALL  MVItATELY 
UHrEETTEATE  THE  CAUEB  OF  FAILURE  AHB-  REPENT  TW  RES^Tl  OP  IlHmTlEATIHi 

tm  RBrAiLi  OP  rm  fhepeeeb  caENtcrm  wrim  mU)  rw  fhocue  urn  m- 

TERIALI.  AA  APPLICAHLE..  ANB  <ll)  ALL  RRfTE  OP  FEOB^  WrCH  RENE  NAHUPAC- 
TWEE  WBW  TW  UM.CORBmOHi  AHE  MICM  THE  SrwBUWEWT  COHSIBEm  SWJECT 
TE  THE  SAME  FAILUEE.  UPORTS  SMALL  H  PMHEESO  TE  TNtjmPQHElBU  TICM- 
■  ICAL  ACrlVTTT  REliERATEE  IB  THE  OmSM^s  TMHMM  THE  BENLITT  HmmAa 
IWEBSarTATIYE.  ApTB  r.lBEECTrW  setw  |0  MWjwiaEr  MITiaHaL  . 
SHHPU  UMITS  SMALL  EE^RWWgWE  TErHiW  CaHl^nW^  SE^jE^  SEE  1 
mepe^iee  may  EE  saErsTEtxE  ar  eeMe  recmeret  it  tm  9iK«Hr. 

Fieal  Acamwcs  mm.  SEXPMavr  hill  k  mitmneu  uetil  RgiMEPEcraw  ecmlts 

MATE  SHONN  THAT  TW  CERRecrTYC.  ACTtM  MAE  CPPECriVt. 

4. 1.7.5  OlSPOEITIOE  OP  MEITS  SUBJECT  TO  SroUP  C  TuTSI. 
Units  that  have  been  suBjecriB  to  mroop  l  texts  sh^  BS'.RECflNOiTiEMO 

AS  MGSSSARY  AMB  MILL  BE  TESTES  FOR  COPPLIANCE  TO  GROUP  A  TESTS  AMO  SIS- 
HITTEB  FOR  ACCEPTARCE  FOR  DELIVERY. 

4.2  Irspection  ano  Test  EauiPHorr  Reouired 
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APPENDIX  C 


Appendix  C  contains  samples  of  drawings  with  the  tide  block  "clipped”  and  the 
resulting  character  recognition  results.  Each  page  has  three  sections: 

1.  A  portion  of  the  original  drawing. 

2.  A  "clipped”  segment  of  the  drawing  used  for  recognition. 

3.  The  characters  that  the  recognition  system  resolved. 
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APPENDIX  D 


Appendix  D  contains  samples  of  the  Ranking  Reject  report  and  records  from  the 
Statistical  Analysis  B/C  and  Noise/Skew  Analysis. 
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RANKING  IMAGES~.REJECTING  040  OUT  OF  046  IMAGES 
IMAGE  RLE  Hard  Oisk:OPTlX:Light  ImagesilmagelO  REJECTED, 
IMAGE  FILE  Hard  Disk;0PTlX;Dar1<  ImagesJmageZ  REJECTED, 
IMAGE  FILE  Hard  Disk.-OPTIX;Ught  ImagesrlmageA  REJECTED, 
IMAGE  RLE  Hard  Disk.-OPTIX.lt,imag8S,L71  REJECTED, 

IMAGE  RLE  Hard  Disk:OPTIX;Ught  Images:irnage3  REJECTED, 
IMAGE  FILE  Hard  Disk:OPTIX;Dark  ImagesJmageS  REJECTED, 
IMAGE  RLE  Hard  Disk:OPTIX;Ught  Images:lrnage1  REJECTED. 
IMAGE  RLE  Hard  Oisk:OPTIX;Dark  ImagesrlmageS  REJECTED, 
IMAGE  RLE  Hard  Disk;0PTIX.-a,images,La7  REJECTED. 

IMAGE  RLE  Hard  Disk.-OPTIX.tt.irnages.L70  REJECTED, 

IMAGE  RLE  Hard  Disk:0PTlX.lt,images.LS4  REJECTED, 

IMAGE  RLE  Hard  Disk:OPTIX;Oark  lmages:lmage2  REJECTED, 
IMAGE  RLE  Hard  Disk:OPTIX:Ught  ImagesJmageS  REJECTED, 
IMAGE  FILE  Hard  Disk:OPTIX:Dark  lmages:Copy  of  Imag  REJECTED, 
IMAGE  FILE  Hard  Disk;OPTIX.tt,images,LS3  REJECTED, 

IMAGE  RLE  Hard  Disk:OPTIX;Oark  ImagesJmageS  REJECTED, 
IMAGE  FILE  Hard  Disk:OPTIX.tt.images,L6Q  REJECTED, 

IMAGE  RLE  Hard  Disk:OPTIX;Dark  Images:lmage3  REJECTED, 
IMAGE  FILE  Hard  Disk:OPTIX.tt.images,LS1  REJECTED. 

IMAGE  FILE  Hard  Disk;OPTIX:Oark  images:lmage4  REJECTED, 
IMAGE  FILE  Hard  Disk;OPTlX.lt.images.LS5  REJECTED, 

IMAGE  FILE  Hard  Oisk:OPTIX.lt.images.LS3  REJECTED. 

IMAGE  FILE  Hard  Disk:OPTIX;Ught  ImagesrlmageS  REJECTED. 
IMAGE  FILE  Hard  Disk.OPTIXcGood  ImagesrCopy  of  Imag  REJECTED, 
IMAGE  RLE  Hard  Disk:OPTIX.-ll.images,L62  REJECTED, 

IMAGE  FILE  Hard  Disk:OPTIX:Good  Images;image2  REJECTED, 
IMAGE  FILE  Hard  Disk.-OPTIX.tt.images.LSS  REJECTED, 

IMAGE  FILE  Hard  Disk.OPTIXiGood  Images:lmage7  REJECTED, 
IMAGE  FILE  Hard  Disk;OPTIX;Light  Ifnages:lmage2  REJECTED, 
IMAGE  FILE  Hard  Disk--OPTIX:Good  ImagesJrnageS  REJECTED, 
IMAGE  FILE  Hard  Disk.-OPTIX.lt.images,LS3  REJECTED. 

IMAGE  FILE  Hard  Disk:OPTIX:Good  ImagesJmageS  REJECTED, 
IMAGE  FILE  Hard  Oisk:OPTIX:Ught  ImagesJmageS  REJECTED, 
IMAGE  FILE  Hard  Disk;OPTIX:Dark  Imagesrlmagel  REJECTED, 
IMAGE  FILE  Hard  Disk.-OPTIX.-lt.images,LS9  REJECTED, 

IMAGE  FILE  Hard  DiskrOPTIXiGood  ImagesJmageS  REJECTED, 
IMAGE  RLE  Hard  Oisk.-OPTlX.-tt.images,LS3  REJECTED, 

IMAGE  FILE  Hard  Disk:OPTIX.-tt.imag8S,L57  REJECTED. 

IMAGE  FILE  Hard  Disk:OPTIX;Gaod  Imagesrlmagal  REJECTED, 
IMAGE  RLE  Hard  Disk;OPTIX.lt.images.L72  REJECTED, 


B/C-0.5aa961,  NO.QQ23 
S/C-2.44S409,  No.OQI  6 
B/C-0.669436,  No.Q022 
a/c-2.4a4g4g.  no.0044 
B/C-O.72S0a0.  NO.Q020 
B/C-2,21326S,  No.QOIS 
B/c-o.75iaa3,  No.ooia 
B/C-1.921259,  No.a014 
B/C-0.7SS237,  No.OOAO 
B/C- 1.8861 16,  NO.0Q43 
a/C-0.770421 ,  NO.Q037 
B/C-1, 852751,  No.QOlO 
B/C-0.772Q54,  No.0023 
B/C-1 .794493.  No. 00 12 
B/C-0.772473,  No.0031 
B/C-1 .756459,  No.OQI  7 
8/C-0.776121,  No.a033 
B/C-1. 683893,  No.OQ1 1 
B/C-0.776151,  No.aQ34 
B/C-1. 634963,  No.OQI  3 
B/C-0.794734,  No.003a 
B/C-1. 606735,  No.0042 
B/C-0.306325.  NO.002S 
B/C-1 .527753,  No.0003 
B/C-0.312163,  No.0035 
B/C-1.S15312,  No.OOOl 
B/C-0.852001,  No.0039 
B/C-1 . 494251,  No.0007 
B/C-0.a92151,  No.OOIS 
B/C-1. 47071 4,  No.0008 
8/C-0.899220,  NO.0Q36 
B/C-1 .4621 63,  No.0005 
B/C-a.344345,  NO.Q024 
B/C-1. 363763,  NO.00Q9 
B/C-0.949037,  No.0032 
B/C-1. 326800,  No.0005 
B/C-1 .083773,  No.0041 
B/C-1 .31 9862.  NO.0Q29 
B/C-1. 115314,  No.OOQQ 
B/C-1 .309576,  NO.004S 


Sample:  Ranking  Reject  Report 

The  Batch  Control  file  was  set  to  reject  90  percent  of  the  batch  starting  with  the  most  extreme 
values  and  moving  toward  the  center  or  average  B/C.  This  report  is  interspersed  with  the 
individual  image  reports.  In  practice,  a  more  normal  percentage  might  be  5  to  10. 
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STANOARD  DEVIATION:  0.301408 
ACCEPTED  on  review 

EVALUATING  IMAGE  iWOOS  RLE:  Hard  DisktlmagesrGood  Imagea:image8 

BLACK  COUNT:  C412 

G4  RLE  SIZE  3S51 

B/C  VALUE:  1.470714 

MEAN  B/C:  1.277713 

B/C  VARIES  FROM  AVG  BY:  0.192396 

STANOARD  DEVIATION:  0.233088 

ACCEPTED 

RE-EVALUATING  IMAGE  MOOS  RLE:  Hard  DisielmagesdSood  ImagesiImageS 

B/C  VALUE:  1.462168 

MEAN  B/C:  1.277718 

B/C  VARIES  FROM  AVG  BY:  0.184449 

STANDARD  DEVIATION:  0.293088 

ACCEPTED  on  review 

RANKING  IMAGES...REJECTING  002  OUT  OF  009  IMAGES 

IMAGE  FILE  Hard  Disl<:lmages:Gaod  Images:lmage1  REJECTED,  B/C-1. 115314,  No.0000 
IMAGE  FILE  Hard  Disk;Images:Good  lmag8s:Copy  of  Ima  REJECTED,  S/C- 1,527753,  No.0003 


EVALUATING  IMAGE  MOOS  RLE:  Hard  Disk:lmages:Oark  Imagas:lmagel 

BLACK  COUNT:  F7S5 

G4  RLE  SIZE  8S5C 

B/C  VALUE:  1.363763 

MEAN  B/C:  1.285541 

B/C  VARIES  FROM  AVG  BY:  0.078227 

STANDARD  O0/IATION:  0.280541 

ACCEPTED 

RE-EVALUATING  IMAGE  MOOS  FILE:  Hard  Oisk:lmages:Good  Imagas:lmag8S 

B/C  VALUE:  1.326800 

MEAN  B/C:  1.285541 

B/C  VARIES  FROM  AVG  BY:  0.041259 

STANDARD  DEVIATION:  0.280541 

ACCEPTED  on  review 

EVALUATING  IMAGE  40010  FILE:  Hard  Disk:lmages:Dark  Imag8s:lmaga2 

BLACK  COUNT:  BFSB 

G4  FILE  SIZE  3748 

B/C  VALUE:  1.352761 

MEAN  a/C:  1.332809 

B/C  VARIES  FROM  AVG  BY;  0.513952 

STANDARD  DEVIATION:  0.311002 

REJECTED 

RE-SVALUATING  image  40007  FILE:  Hard  Disk:Irnages:Good  Images:lmag87 

B/C  VALUE:  1.494251 

MEAN  B/C:  1.332803 

B/C  VARIES  FROM  AVG  BY:  0.161441 

STANDARD  DF/IATION:  0.311002 
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ACCEPTED  on  review 


EVALUATING  IMAGE  #0011  FILE;  Hard  DtskrlmagesrDark  Iniages:lmage3 

BLACK  COUNT;  17BQC 

G4  RLE  SIZE  Ell  A 

a/C  VALUE;  1.683333 

MEAN  8/C:  1.359816 

a/C  VARIES  FROM  AVG  BY;  0.324077 

STANDARD  DEVIATION:  0.313104 

ACCEPTED 

RE-EVALUATING  IMAGE  #0008  FILE;  Haid  Dislclmagas;Goad  Images;lmage8 

B/C  VALUE;  1.470714 

MEAN  B/C;  1. 3598 16 

B/C  VARIES  FROM  AVG  BY:  0.110898 

STANDARD  DEVIATION;  0.313104 

ACCEPTED  on  review 


EVALUATING  IMAGE  #0012  FILE;  Hard  Disk;Images;Oark  lmages;CaDy  of  Ifnage3 

BLACK  COUNT:  6607 

G4  FILE  SIZE  334F 

B/C  VALUE;  1.794493 

MEAN  B/C;  1.390864 

B/C  VARIES  FROM  AVG  BY;  0.403628 

STANDARD  DEVIATION;  0.321813 

REJECTED 

RE-EVALUATING  IMAGE  #0009  FILE:  Hard  Oisk:lrnages:Oari<  Images:fmage1 

B/C  VALUE:  1.363768 

MEAN  B/C:  1.390864 

B/C  VARIES  FROM  AVG  BY;  0.027037 

STANDARD  DEVIATION;  0.321813 

ACCEPTED  on  review 

EVALUATING  IMAGE  #0013  FILE:  Hard  Disk:lrnagas:Dafk  ImagesilmageA 

BLACK  COUNT:  17C37 

G4  FILE  SEE  E3C3 

B/C  VALUE:  1.634368 

MEAN  B/C;  1.407133 

B/C  VARIES  FROM  AVG  BY;  0.227330 

STANDARD  DEVIATION;  0.316807 

ACCEPTED 

RE-EVALUATING  image  #0010  FILE;  Hard  Oisk;Images;Dafk  Images;lrnage2 

B/C  VALUE:  1.352761 

MEAN  8/C;  1.407133 

B/C  VARIES  FROM  AVG  BY:  0.445623 

STANDARD  DEVIATION:  0.316807 

rejected  on  review 

EVALUATING  IMAGE  #0014  FILE:  Hard  Oisk;lmagas:Dark  Images:lmage5 
BLACK  COUNT;  C02S 
G4  file  size  6403 
B/C  VALUE;  1.921 259 
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a/C  VALUE:  1.321 259 

MEAN  B/C:  1.549653 

B/C  VARIES  FROM  AVG  BY:  0371604 

STANDARD  DEVIATION:  0.412SS2 

ACCEPTED  on  review 

RANKING  IMAGES-REJECTING  002  OUT  OF  009  IMAGES 

IMAGE  FILE  Hard  Disk:Images:Dark  Imagss:{mag8l  REJECTED,  B/C-1. 363768,  Na.a009 
IMAGE  FILE  Hard  Disk:lmagas:Oari(  Imagas:imaga7  REJECTED,  S/C«2. 446409,  No.0016 


EVALUATING  IMAGE  iWOlS  FILE;  Hard  Disk:lmag8s:Light  Images:lmaga1 

BLACK  COUNT:  7940 

G4  FILE  SIZE  A1 43 

B/C  VALUE;  0.751883 

MEAN  B/C;  1.509767 

B/C  VARIES  FROM  AVG  BY:  0757884 

STANDARD  DEVIATION:  0.438087 

REJECTED 

RE-EVALUATING  IMAGE  iSOOIS  FILE;  Hard  Oisk:lmages:Dari<  lmages:lmageS 

B/C  VALUE;  2.213266 

MEAN  B/C:  1.509767 

B/C  VARIES  FROM  AVG  BY:  0.703499 

STANDARD  DEVIATION:  0.438087 

REJECTED  on  review 

EVALUATING  IMAGE  ilt0013  RLE;  Hard  Disk:lrnages:iJght  Imag8s:lmag82 

SLACK  COUNT:  4805 

G4FILE  SIZE  5191 

B/C  VALUE;  0.892151 

MEAN  B/C:  1.480357 

B/C  VARIES  FROM  AVG  BY:  0.588206 

STANDARD  DEVIATION;  0.447304 

REJECTH3 

RE-EVALUATING  IMAGE  iWOlS  FILE;  Hard  Disk:]tnagBs:Dark  Imag8s:lmag97 

B/C  VALUE;  2.445409 

MEAN  B/C;  1.480357 

B/C  VARIES  FROM  AVG  BY:  0.365053 

STANDARD  DEVIATION;  0.447304 

REJECTED  on  review 

EVALUATING  IMAGE  40020  FILE;  Hard  Disk:lmages:Light  ImagesilmageS 

BLACK  COUNT;  81 FF 

G4  FILE  SIZE  3349 

B/C  VALUE;  0.725080 

MEAN  B/C;  1.446026 

B/C  VARIES  FROM  AVG  BY:  0.720946 

STANDARD  O0/IATION:  0.464474 

REJECTED 


RE-EVALUATING  image  40017  FILE;  Hard  Disk;Imag9s:Da/k  Images;lmag8a 
B/C  VALUE:  1.755459 
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Huffman  VR2:  1118 
Huffman  VR3:  313 

Varticality  Index  (Low  number  >  high  varticaiity):  0.106 
Condusion:  This  image  appears  to  be  good. 


RLENAM&  Imaged 

Pixel  Width:  1696 

Pixel  Length:  2200 

Pixel  Total:  .3731200 

Black  Pixels:  401 S58  (about  10%  of  Total  Pixels) 

White  Pixels:  3329642  (about  39%  of  Total  Pixels) 

Black  Orphans:  28  (about  0%  of  Total  Black) 

White  Orphans:  27  (about  0%  of  Total  White) 

Ratio  of  black  orphans  to  total  white  pixels:  0.000008 
Ratio  of  white  orphans  to  total  black  pixels:  0.000067 

HufftnanHORZ:  5220 
Huffman  PASS:  3623 
Huffman’ VO:  95679 

Huffman  VLl:  12013 
Huffman  VL2:  1346 
Huffman  VL3:  312 
Huffman  VRI:  11223 
Huffman  VR2;  1560 
Huffman  VR3:  447 

Verticality  Index  (Low  number  *  high  verticality):  0.072 
Condusion:  This  image  appears  to  be  good. 


FILENAME;  Imagal 

Pixel  Width:  1 696 

Pixel  Length:  2200 

Pixel  Total:  3731200 

Black  Pixels:  506536  (about  13%  of  Total  Pixels) 

White  Pixels:  3224664  (about  36%  of  Total  Pixels) 

Black  Orphans:  493  (about  0%  of  Total  Black) 

White  Orphans;  38  (about  0%  of  Total  White) 

Ratio  of  black  orphans  to  total  white  pixels:  0.000153 
Ratio  of  white  orphans  to  total  black  pixels:  0.000075 

Huffman  HORZ;  3391 
Huffman  PASS;  5943 
Huffman  VO;  99763 
Huffman  VLl;  16347 
Huffman  VL2;  1927 
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Pfx0i  Total: 

3731 200 

Black  Pixais: 

139197 

(about  3%  of  Total  Pixels) 

Whita  Pixels: 

3592003 

(about  96%  at  Total  Pixels) 

Black  Orphans: 

673  (about  0%  of  Total  Slack) 

Whita  Orphans: 

31  (about  0%  of  Total  Whits) 

Rada  of  black  orphans  to  total 

whita  pixels:  0.000189 

Ratio  of  whita  orphans  to  total  black  pixels:  O.OOQ582 

Huffman  HORZ  S8SS 

Huffman  PASS:  41 62 

Hufftnan  VO: 

29117 

Huffman  VLl: 

5032 

Huffman  VL2: 

1286 

Huffman  VL3: 

561 

Huffman  VRi: 

5322 

Huffman  VR2; 

1  144 

Huffman  VR3: 

342 

. 

Varticaiity  Index  (Low  number 

»  high  verticality):  0.234 

Conclusion:  Bad 

(mage  (white  speckles  In  black  areas) 

FILENAME:  Images 

Pixel  Width: 

1696 

Pixel  Length: 

2200  • 

Pixel  Total: 

3731200 

Black  Pixels: 

88643 

(about  2%  of  Total  Pixels) 

White  Pixels: 

3642557 

(about  97%  of  Total  Pixels) 

Slack  Orphans;  36  (about  0%  of  Total  Slack) 

White  Orphans:  27  (about  0%  of  Total  White) 

Ratio  of  black  orphans  to  total  white  pixels:  0.000010 
Ratio  of  whits  orphans  to  total  .black  pixels:  0.00030S 

Huffman  HORZ;  2433 
Huffman  PASS;  1  658 
Huffman  VO:  23539 
Huffman  VLl:  3232 
Huffman  VL2;  SS3 
Huffman  VL3:  269 
Huffman  VRi:  290S 
Huffman  VR2;  S67 
Huffman  VR3;  222 

Verticality  Index  (Low  number  ■  high  verticality);  0.130 
Conclusion;  Sad  Image  (whits  speckles  in  black  areas) 


FILENAME;  Imaga7 
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